Showing posts with label etl. Show all posts
Showing posts with label etl. Show all posts

Thursday, 23 August 2018

Crash the bottleneck query execution times using ETL tool for the end clients and get additional ETL tool sales





For most of the companies, the transactional queries take a lot of time. M&N BI’s offerings help crash the execution times of the transaction queries. This should help the end client with the following:
·         Meeting the SLAs of the Chief Technology Officers.
·         Saving of the time in nightly processing. For example the nightly load could take 5 hours instead of 8 hours. With the additional 3(three) hours, the end client could develop additional dashboards and reports or restart the process in case of failure.
·         Readymade datawarehouse for developing analytics and dashboards.
·         Real time ETL for enabling the data extract
·         Lower load on the transaction system.
·         Lower configuration of servers.
·         Lower manpower support costs.

How does the ETL team do the same and what is required?
·         Bottleneck sql queries from the end client: time of execution and the criticality of the process.
For whom is this offering useful?
·         End clients that require the queries to be executed quickly.
·         ETL and data analytics companies looking for end clients.

How will the ETL team solve the problem?
·         Get access to the bottleneck sql
·         Design the optimized sql flow: M&N BI end.
·         Implement the same using an ETL tool: ETL tool company/BI tool company
·         Generate reports using the BI tool/SQL: BI tool company

Why consider our firm?
·         Strong ETL expertise: please see our cloud offerings
·         Ability to work with multiple ETL tools
·         Expertise at reverse engineering cursor sql code to set based sql code. Sample cases can be shown to the end client.
·         Developed readymade ETL products in C#/.Net. one of the products is already deployed with a GSP partner on cloud.
·         Expertise at developing datawarehouses in sql with quickness and ease.
·         High value for the ETL company/BI tool company
·         Readymade datawarehouses with ETL connectors  for sale available with the ETL team.


Next steps:
·         Send the bottleneck sql to the ETL team at apoorv@mnnbi.com,prashant@mnnbi.com.
Attached blogs:

Our latest project has been ETL integration on the cloud for a GSP partner in India:
•             Automation of GST filings(in collaboration with Hazel GSP).
Attached is a blog for the same:



•             Blog link: http://mnnbi.net/gst/gst.aspx



•             Preliminary video: https://www.youtube.com/watch?v=-Vp7JzHCYp0&feature=youtu.be


•             Detailed demo link: https://youtu.be/d-KD3mp1jic




Other blogs:

Other blogs:

GST(cloud services): http://mnnbi.net/gst/gst.aspx



Inventory analytics: http://mnnbi.net/






Monday, 15 January 2018

Reducing long query times through data compression and sql reduction

Nightly process completion at Afro Incorporation
Irfan, Production Manager, met Sohail(IT Head) in the meeting room.
Irfan: what happened champ? Look worried?
Sohail: It is the nightly report process that begins at 12 am. It is not completing by 9 am. Suneet(IT Manager) is asking for a new server costing Rs. 25 lakhs. Currently my SLA(service level agreement) is not been met.
Irfan: what will happen with the new server?
Sohail: will speed it up. The management is saying that there is no budget left for this year for IT.
Irfan: Now what?
Sohail: am stuck. How is it going for you?
Irfan: very nice. Since the new Japanese(Takashida) came in. He is removing the constraints in production, reducing inventory and increasing throughput. Why do you start the daily process at 12 am. Why not before?
Sohail: because complete data comes by midnight.
Irfan: say a transaction has happened at 11 am in the morning, then  as per the production team, it is in stock for 13 hours since the other data has not come. Am I correct?
Sohail: correct.
Irfan: Takashida would pre process the data immediately and remove the constraint. He would then store the same in a Work in progress area so that the final fitment is quick.
Sohail: basically work for 24 hours instead of 9 hours.
Irfan: correct. Remove the time constraint. But how would you store the work in progress output?
Sohail: I had this consulting team from M&N BI come up to me that it could store the Work in progress output in a separate database by pre processing the business logic
He gave me this link for data consolidation, datatransformation, data cleansing and even Business Intelligence from his website. The company was saying that even advanced analytics and resolving complex inventory issues should be possible by using its products.
What do you suggest?
Irfan: Let us see what Wasim(CEO) says.

An example of what his team has done for another firm is attached herewith:
http://mndatasolutionsindia.blogspot.in/2018/01/query-reductionimplementation-example.html


If you have the same problem as Sohail, contact the following
By:
Name: Apoorv Chaturvedi
Website: www.mnnbi.com
Phone: +91-8802466356


Initial and Incremental data Load Template by M&N Business Intelligence-SAP Data Services

  INCREMENTAL LOAD/CREATION OF DIMENSION TABLE LOGIC AT SAP DATA SERVICES END CLIENT In this particular document we shall be looking at the ...